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Abstract Percolation theory is extensively studied in statistical physics and 
mathematics with applications in diverse fields. However, the research is fo- 
cused on systems with only one type of links, connectivity links. We review a 
recently developed mathematical framework for analyzing percolation prop- 
erties of realistic scenarios of networks having links of two types, connec- 
tivity and dependency links. This formalism was applied to study Erdos- 
Renyi (ER) networks that include also dependency links. For an ER network 
with average degree k that is composed of dependency clusters of size s, 
the fraction of nodes that belong to the giant component, Poo, is given by 
Poo — P s _1 [1 — ex P {—kpPoo)) s where 1 — p is the initial fraction of ran- 
domly removed nodes. Here, we apply the formalism to the study of random- 
regular (RR) networks and find a formula for the size of the giant component 
in the percolation process: — p s_1 (l — r k ) s where r is the solution of 
r = p s (r fc_1 — 1)(1 — r k ) + 1. These general results coincide, for s — 1, with 
the known equations for percolation in ER and RR networks respectively 
without dependency links. In contrast to s — 1, where the percolation transi- 
tion is second order, for s > 1 it is of first order. Comparing the percolation 
behavior of ER and RR networks we find a remarkable difference regarding 
their resilience. We show, analytically and numerically, that in ER networks 
with low connectivity degree or large dependency clusters, removal of even a 
finite number (zero fraction) of the network nodes will trigger a cascade of 
failures that fragments the whole network. Specifically, for any given s there 
exists a critical degree value, k m i n , such that an ER network with k < k m i n 
is unstable and collapse when removing even a single node. This result is in 
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contrast to RR networks where such cascades and full fragmentation can be 
triggered only by removal of a finite fraction of nodes in the network. 

Keywords Percolation ■ Networks • Cascade of failures ■ Dependency links 

1 Introduction 

Percolation is a primary model for disordered systems which is extensively 
studied both in mathematics [HUE] and in statistical physics [TP^WilT] and 
have applications in diverse phenomena in different disciplines ranging from 
porous materials [5] and branched polymers [5] to forest fires [TU] and epi- 
demics spreading [TT]- In network science |121ll3U14U15HTCl[T71H51fTgil20U21l[^l 
I23ll24ll25] . percolation theory is particular useful in studying robustness of 
networks to a failure of their components [26,27,28,29 . For a given network, 
when nodes are removed with probability 1 — p, or occupied with probabil- 
ity p, the percolation theory explains the existence of a critical probability, 
p c , such that for p below p c the network is composed of isolated small clus- 
ters but for p above p c a giant cluster, of fraction of the network, spans 
the entire network. The percolation process represents a phase transition 
of second-order where (the order parameter) approaches continuously 
to zero when p approaches p c from above. The value of p c is considered as 
a measure for the network robustness. When p c is smaller, the network is 
more robust since more nodes have to be removed from the network in or- 
der to fragment it completely. The results of percolation theory were useful, 
for example, to evaluate the resilience of the internet against random |26j 
or malicious attacks 27,28,29,30,31 or to develop efficient immunization 
strategies [ggimiMlIM] ■ 

Percolation theory assumes that the network elements are connected by 
one type of links, connectivity links. However, in real systems, usually there 
exist two types of links, connectivity links for the function of the network and 
dependency links which represent that the function of given elements depend 
crucially on others. Network models containing both connectivity and depen- 
dency links were introduced recently for two interdependent networks [35 , 36 
and for single networks [371138] . For further recent studies of interdependent 
networks see Refs. [gg H jU H U H H] . 

Here, we review the general formalism for analyzing a single network 
composed of connectivity and dependency links and the results obtained for 
Erdos-Renyi (ER) type networks. We apply here the formalism to analyze 
random-regular (RR) networks composed of these two types of links. We 
also compare between the results of ER and RR networks and show that in 
the presence of dependency links, RR networks are significantly more robust 
compared to ER networks. This is in contrast to the case of no dependency 
links where ER are more robust than RR networks. 

2 General formalism 

When nodes fail in a network containing both connectivity links and depen- 
dency clusters, two different processes occur, (i) Connectivity links connected 
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Fig. 1 (Color online) Connectivity networks with dependency clusters. The edges 
represent connectivity relations, while the (blue, red and green) groups surrounded 
by curves represent dependency relations between all the nodes of the same group 
(color). The dependency relations can be between very " far" nodes in the con- 
nectivity network, (a) ER network with dependency clusters, (b) RR network with 
dependency clusters where all nodes have same degree k — 3. 

to the failed nodes also fail, causing other nodes to disconnect from the net- 
work (connectivity step), (ii) A failing node cause the failure of all the other 
nodes of its dependency cluster, even though they are still connected via con- 
nectivity links (dependency step). Thus, a node that fails in the connectivity 
step leads to the failure of its entire dependency cluster, which in turn leads 
to a new connectivity step, which further leads to a dependency step and so 
on. Once the cascade process is triggered it will stop only if nodes that fail 
in one step do not cause additional failure in the next step. 

In order to describe the network size during the cascade and, in particular, 
to find its size at steady state, two functions are defined, go(T) and g p (T), 
evaluating respectively the effect of the dependency clusters and the effect 
of the connectivity process on the network at each step of the cascade. After 
random removal of 1 — T of the nodes, the size of the giant component is given 
by g p (T) and, equivalently, the part of the network that is not dependent 
on the removed nodes (and, thus, remain functional) is given by gu{T). 
Thus, when applying the dependency process on a network of size x the 
remaining functional nodes consisting of a fraction gr)(x), which is a fraction 
4> = x go{x) of the N nodes in the original network. Similarly, applying 
the connectivity process on a network of size y results in a remaining giant 
component consisting of a fraction g p {y) which is a fraction 4> = yg p (y) of 
the N nodes in the original network. 



The state of the network at steady state is given, according to (38], by 

the two equations: y = pgo{x) and x = pg P {y), which can be reduced to a 
single equation: 



Solving equation ([I) we obtain the size of the network at the end of a cascade 
initiated after random removal of 1 — p of the nodes. 

This formalism is general for any network having connectivity and depen- 
dency links. In Sect. [3] we evaluate explicitly the function g p , describing the 




x = 



pg P (pgD{x)). 



(1) 



4 



connectivity process and in Sect. [4] we evaluate the function gu, describing 
the action of the dependency links. 



3 Connectivity process 

The percolation process can be solved analytically using the apparatus of 
generating functions. We introduce the generating function of the degree dis- 
tribution Go(£) = ^2kP(k)£ k ' wnere P{k) is the probability of a node to 
have k connectivity links [i3lH¥lH5] . Analogously, we introduce the generat- 
ing function of the underlining branching processes, Gi(£) = G' (£)/G' (l). 
Random removal of a fraction 1 — T of nodes will change the degree dis- 
tribution of the remaining nodes, so the generating functions of the new 
distribution are equal to the generating functions of the original distribution 
with the argument equal to 1 — T(l — £) [43]- Thus, the fraction of nodes that 
belong to the giant component after the removal of 1 — T nodes is : 

g p (T) = l-G [l-T(l-u)] ) (2) 

where u = u(T) satisfies the self-consistency relation 

u = Gi[l -T(l -u)\. (3) 

Eqs. © and © describe generally random networks having any degree 
distribution. Specifically, we analyze two random network models that can be 
solved explicitly. In l3.1l we consider ER networks, whose connectivity degrees 
are Poisson-distributed [151H71H5] . and in !3.2l we consider RR networks, where 
all nodes have the same connectivity degrees k. 



3.1 Erdos-Renyi (ER) networks 

Erdds-Renyi (ER) networks are networks with a Poissonian degree distribu- 
tion, 

P(k') = ^e-\ (4) 

where k' is the degree of the node and k is the mean degree. For ER network 
with average degree k the generating functions are [49] . 

Go(0=G 1 (0=exp[A;(e-l)]. (5) 

Thus, according to Eqs. © and ©, 

g p (T) = l-u (6) 

where u satisfies the self consistent equation 

u = e -*r(i-»). (7) 
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The steady state at the end of the cascade, given in Eq. ([T]), becomes 

x = p(l-u) (8) 

u — e -kpg D (x)(l-u) 

which can be reduced to a single equation for u 

u = e - fc P9D(p(l-«))(l-«)_ (g) 

In order to present u, obtained from Eq. ((9]), in terms of Poo recall that the 
size of the giant component of the network at the steady state, 0oo, is given 
by <poo = xgo(x), where x is the solution of Eq. ([5]). The remaining fraction 
of the network at the end of the cascade, Poo, out of the initial fraction p 
is given by P x = 4>oo/p- Thus, we get the relation Poop = xgo(x). Finally, 
using (O a simple equation for P^ is obtained 

• (10) 

where u is the solution of Eq. . 



3.2 Random-Regular (RR) networks 

IN RR networks all nodes have the same connectivity degree k. In this case 
the generating function of the degree distribution is Go(£) = £ fe and the 
generating function of the underlying branching process is Gi(£) = £, k ~ 1 , 
thus, G (0 = [Gi^)] 7 ^ 1 - According to Eqs. © and © 

g p (T) = l-u^, (11) 

where u satisfies the self consistent equation 

u=[l + {u-l)T] k -\ (12) 

The steady state at the end of the cascading process is given by Eq. (JXJ) 

x=p(l-u^) (13) 
u= [l + (u-l)pg D (x)] k - 1 , 



Once system JT3l) is solved, the size of the giant component is given by 
Poo = xg D (x)/p. 
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4 Dependency process 

In the general case, when dependency links exist, each node belongs to a 
dependency group of size s with a probability q(s) so that the number of 
groups of size s is equal to q(s)N/s. Since after random removal of 1 — T 
of the nodes each group of size s remains functional with a probability T s , 
the total number of nodes that remain functional is given by YlT=i <l{s)NT s . 
Thus, we define the function go(T) as the fraction of nodes that remain 
functional out of the TN nodes that were not removed, 

oo 

9D {T)=Y,qWr>-\ (14) 

s=l 

In particular, when all dependency clusters have the same size, s, 

g D {T) = T s - 1 . (15) 



5 ER and RR networks with dependency clusters of the same size 

5.1 ER network with dependency clusters of the same size 

The percolation of an ER network with average connectivity degree k and 
dependency clusters of size s is described by substituting Eq. (fT5|) into ^ 

u = e -fcp s (i-«) 3 ; ( 16 ) 

where 1 — p is the initial fraction of removed nodes. The size of the giant 
cluster, Pqo, is given, using Eqs. (IToT) and (fTU|) . by 38 , 

Poo = p s - 1 [l-exp{-kpP 00 )\ s (ER). (17) 

Eq. (fi~7|) coincides for s = 1 (a node depends only on itself, i.e., no de- 
pendency links) with the known Erdds-Renyi equation 46,47,48 , Poo = 
1 — exp (— fcpPoo), for a network without dependency relations. Moreover, for 
s = 2, Eq. (fT?) yields the result obtained in [37] for the case of dependency 
pairs. The cases of q(s) being Gaussian or Poissonian were also studied by 
Bashan et al [55] , 

Fig. [5] shows the size of the giant cluster, 0oo = PooP, versus the fraction 
of nodes, p, remaining after an initial random removal of 1 — p, for the case 
of ER network with fixed size of dependency clusters s. The case of s = 1, 
where each node depends only on itself, is the known regular second order 
percolation transition. For any s > 2, a first order phase transition char- 
acterizes the percolation process. Both the regular and the new first order 
percolation obey Eq. (fT7j) . 

Next, we describe how to find analytically the percolation threshold, p c , 
for the case of ER network with a fixed size s of dependency clusters [35] . Eq. 
([To]) , which is the condition for a steady state, have a trivial solution at u = 1, 
which corresponds, by ([TO]) , to a complete fragmentation of the network. For 
large p there is another solution of < u < 1 , corresponding to the existence 
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Fig. 2 Simulation results of the relative size of the giant component, </>oo = PooP, 
versus p for ER networks (open symbols) and RR networks (full symbols) with 
connectivity degree k = 5 compa red with the theory (solid lines) as obtained from 
Eq. dTTJ) for ER and from Eq. ((24)) for RR. For the case of s = 1 there are no 
dependency clusters and the regular percolation process leads to the known second- 
order phase transition. For s > 2, a first order phase transition characterize the 
percolation process represented by discontinuity of at p c . Both the regular 
seco nd-o rder and the first-order percolation transitions obey Eq. (|17p for ER and 
Eq. (|24|l for RR. Note that while for s = 1 ER networks are more stable than RR 
networks (p c is smaller in ER than in RR) as s increases the RR networks become 
more stable compared to ER. 



of a giant component being a finite fraction of the network. Therefore, the 
critical case corresponds to satisfying both the tangential condition for Eq. 

(USD, 

1 = kp s su{l - u) s -\ (18) 

as well as Eq. (fT^|) . Thus, combining Eqs. (fT5|) and ([To]) we obtain a closed- 
form expression for the critical value, u c , 

(19) 

Once u c is found, we obtain p c by substituting it into Eq. (|18[) , 

Vc= [ksu c (\-u c ) s - x Y lls . (20) 

For s = 1 we obtain the known result p c — 1/k of Erdos-Renyi [46,47,48 . 
Substituting s — 2 in Eqs. (fH)]) and ([2U]) one obtains p c 2 ~ l/[2fcu c (l — u c )}, 
which coincides with the exact result found in [37] . 

When p c > 1, removal of even a finite number (zero fraction) of the 
network nodes will trigger a cascade of failures that fragments the whole 
network. Moreover, for any given s there is a minimal degree value, 

fcmm(s) = [SU C (1 - Uc) 3 - 1 ] ^ , (21) 
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such that p c for an ER network with k < k m i n is equal to one and the 
network is extremely unstable. Similarly, for any given connectivity degree k 
there exists s max , given by Eq. (|20l) under the condition of p c = 1, such that 
for s > s max , p c > 1 (see Fig. 3(a) I. In Fig. [3] we plot the values of p c as a 
function of s for several k values. 
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(a) ER networks. 



(b) RR networks. 



Fig. 3 (Color online) Critical probability p c for (a) ER and (b) RR networks with 
dependency clusters of size s, for different connectivity degree k: (black) squares 
for k = 5, (red) triangles for k = 8 and (blue) circles for k = 10. While for ER [Fig. 



3(a) 1 — p c drastically drops to zero (p c = 1) at s max , in RR [Fig. 3(b) 1 — p c scale 



as power law, see Eq. (|28l) . and never reaches zero. 



5.2 RR network with dependency clusters of the same size s 

In the case of RR network with fixed size s of dependency clusters, Eqs. ([13"]) 
and (fl~5|) can be reduced to 

u= [{u-l^il-u^y- 1 + l] k -\ (22) 

Introducing a new variable r = u 1 ^ , Eq. (|2"2"|) becomes 

r =p s (r k - 1 -lXl-r^-i + l. (23) 

The size of the giant cluster, , after random removal of 1 —p of the network 
nodes, is given by 

P 00 =p s - 1 (l-r k Y (RR). (24) 

Similar to the case of ER networks, as shown in Fig. [51 the percolation 
process of RR networks, given in Eqs. (|23I24[) . represents a phase transition. 
For p > p c the size of the network at the end of the cascade process, Poo, 
is finite, while for p < p c the network becomes completely fragmented. The 
transition point is given by the tangential condition of Eq. (|23p 
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Solving Eq. (|25|) we obtain the transition point, p c , 



1 



Pc 



(l-^Kl-r*) 



s-l 



(26) 



The size of the giant cluster, P^, at p c is obtained by substituting r c into 
Eq. OH. 

Next we show analytically that for RR networks p c is always smaller than 
1. This is in contrast to ER networks where p c can be equal or larger than 1, 
(see Eq. PTj) - ). As shown in Fig. ©, as the size of the dependency clusters, 
s, increases p c increases and the network becomes more vulnerable. When 
the connectivity degree, k, increases the system becomes more robust and 
p c becomes smaller. In order to check if RR networks can become totally 
fragmented in removal of zero fraction of its nodes, namely, p c > 1, we 
evaluate p c in the limit of large s. For s ^> 1, r c is evaluated from Eq. (|25|) 



'c|s>l 



(27) 



Substituting r c into Eq. (|26p and taking s>lwe obtain 

- 1- (1- l/k)k*=*stt. (28) 



Pc|s»l 



1 ~ A; j V s& 



This formula can explain the power law behavior as a function of s and the 
slopes seen in Fig. |3(b)| Since < r c < 1 and k > 1, we obtained that 
the critical point of the percolation transition p c of RR networks is always 
smaller than 1 for any given s. 



6 Summary 

The synergy between the connectivity and the dependency processes in net- 
works having links of two types, connectivity and dependency links, leads to 
cascade of failures that change the percolation properties of the system. The 
new percolation laws, given by Eqs. (fTT|) and (l24l) for ER and RR networks 
respectively, predict for both ER and RR networks a second-order percola- 
tion transition where no dependency clusters are present and a first-order 
transition for networks with dependency clusters. However, the two topolo- 
gies are dramatically different regarding their stability in the case of large 
dependency clusters. In ER networks with low connectivity degree or large 
dependency clusters, removal of even a finite number (zero fraction) of the 
network nodes may trigger a cascade of failures that fragments the whole 
network. This is in contrast to RR networks where such cascades can be 
triggered only by removal of a finite fraction of nodes in the network. 
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